Making critical autonomous AI-based systems safe

Final event

TRUSTWORTHY AI IN SAFETY-CRITICAL SYSTEMS
Overcoming adoption barriers

Objectives

To improve the explainability and traceability of DL components

To provide clear safety patterns for the incremental adoption of DL software in Critical Autonomous AI-based Systems (CAIS)

To integrate the SAFEXPLAIN libraries with an industrial system-testing toolset

To create architectures of DL components with quantifiable and controllable confidence, and that have the ability to identify when predictions should not be released based on applicability’s scope or security concerns

To design, implement, or update selected representative DL software libraries according to safety patterns and safety lifecycle considerations, meeting specific performance requirements on  relevant platforms

Deep Learning (DL) techniques are key for most future advanced
software functions in Critical Autonomous AI-based Systems (CAIS) in
cars, trains and satellites. Hence, those CAIS industries depend on their
ability to design, implement, qualify, and certify DL-based software
products under bounded effort/cost

Case studies

Railway: This case studies the viability of a safety architectural pattern for the completely autonomous operation of trains (Automatic Train Operation, ATO) using intelligent Deep Learning (DL)-based solutions.

Space: This case employs state-of-the-art mission autonomy and artificial intelligence technologies to enable fully autonomous operations during space missions. These technologies are developed through high safety-critical scenarios.

Automotive: This case develops advanced methods and procedures that enable self-driving cars to accurately detect road users, estimate their distance from the vehicle, and predict their trajectories while adhering to both safety and explainability requirements.

Showing SAFEXPLAIN Results in Action at ASPIN 2025

Showing SAFEXPLAIN Results in Action at ASPIN 2025

The 23° Workshop on Automotive Software & Systems, hosted by Automotive SPIN Italia on 29 May 2025 proved to be a very successful forum for sharing SAFEXPLAIN results. Carlo Donzella from exida development and Enrico Mezzetti from the Barcelona Supercomputing...

Tackling Uncertainty in AI for Safer Autonomous Systems

Tackling Uncertainty in AI for Safer Autonomous Systems

Within the SAFEXPLAIN project, members of the Research Institues of Sweden (RISE) team have been evaluating and implementing components and architectures for making AI dependable when utilised within safety-critical autonomous systems. To contribute to dependability...

40th ACM/SIGAPP symposium on Applied Computing

40th ACM/SIGAPP symposium on Applied Computing

On 4 April 2025, Sergi Vilardell from the Barcelona Supercomputing Center will present "Probabilistic Timing Estimates in Scenarios Under Testing Constraints " as part of the Conference track on System Software and Security EMBS, Embedded Systems. The 40th ACM/SIGAPP...